Neuromagnetic study of pattern recognition activity in the human brain 
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1 Introduction 

According to human patient studies [1], the lesion in 
the inferior temporal cortex and/or in the parietal 
areas causes the agnosia. There are two types of 
agnosia; apperceptive agnosia and association 
agnosia. According to Farah [2], the apperceptive 
agnosia patients seem to have adequate elementary 
visual functions and general cognitive ability, but 
they were dramatically impaired on the simplest 
forms of shape discrimination. On the other hand, 
the associative agnosia patients have a selective 
impairment in recognizing visually presented objects 
despite apparently adequate visual perception. 
However, Farah [2] carefully investigated the 
conventional apperceptive agnosia patients and 
found that the simultanagnosia patients, simultan- 
agnosics, had been included in this apperceptive 
agnosia group because the disturbance of this 
simultanagnosia was very similar to the 
conventional apperceptive agnosia. The simultan- 
agnosics cannot see or recognize more than one 
object. Farah claimed that there are two types of 
simultanagnosia [2]; dorsal and ventral simultan¬ 
agnosia. The dorsal simultanagnosics, having 
damage in the bilateral occipitoparietal regions, 
cannot see more than one object. In contrast, the 
ventral simultanagnosics, having left inferior 
occipitotemporal damage, can see more than one 
object, but cannot recognize more than one object. 
Therefore, when recognizing more than one object, 
both the occipitotemporal and the occipitoparietal 
regions may be activated. 

2 Materials and methods 

2.1 Subjects, stimuli, and tasks 

We studied 12 healthy volunteers (4 females; mean 
age: 25.6 years old), who joined two experiments. 
The stimulus was a 5-element pattern including an 
arrow at the center and four simple figures as shown 
in Fig. 1. The arrow directed to the left or right, and 
the simple figure had four orientations, making in 
total 96 combinations. The same stimulus group and 
sequence (Fig. 2) were used in both Experiment-1 


and Experiment-2. The stimulus duration was 0.1 s 
and the interstimulus interval was random between 
1.9 and 2.3 s. 
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Figure 1: Four examples of stimuli for Experiment-1 
and Experiment-2. In Experiment-1, the subject 
reacted with the right index finger for the stimuli (a) 
and (c), and with the right middle finger for (b) and 
(d). In Experiment-2, the subject reacted with the 
right index finger for (c) and (d), and with the right 
middle finger for (a) and (b). 



reaction key-1 or -2 


Figure 2: Time chart for stimulus sequence and 
reaction key. 

The subjects’ task in Experiment-1 was to react, as 
soon and correctly as possible, by a reaction key-1 
with their right index finger when the central arrow 
directed to the left, and by a reaction key-2 with 
their right middle finger when the central arrow 
directed to the right (See Fig. 1). 

The subjects’ task in Experiment-2 was to react, as 
soon and correctly as possible, by the reaction key-1 
with their right index finger when the two simple 
figures were identical, which were presented to the 







visual field (left or right) specified by the central 
arrow, and by the reaction key-2 with their right 
middle finger when the two simple figures were not 
identical, which were presented to the visual field 
specified by the central arrow (See Fig. 1). 

2.2 Recording and analysis 

We recorded the magnetic responses by a whole- 
scalp neuromagnetometer (Neuromag-122™, 
Neuromag, Ltd., Finland). Any epoch that showed 
more than 150 |LiV electrooculogram or more than 
3000 fT/cm magnetic response in any channel was 
rejected. After the analog filter application (0.03 ~ 
100 Hz), the magnetic responses were digitized at 
0.5 kHz, and then averaged more than 80 epochs. 
After averaging, the digital lowpass filter (cutoff: 
40 Hz) was applied, and then the DC-offset was 
removed by setting the baseline from -100 to 0 ms. 
The grand mean waveforms averaged across 12 
subjects were calculated after virtually shifting each 
subject’s head position and orientation to the 
standard position and orientation. 


The equivalent current dipoles (ECDs) were 
estimated by the local channel selection method with 
a single dipole in a spherical head model [3]. After 
ECD estimation, we calculated the active latency 
length in each of 28 brain regions of interest in each 
hemisphere. We refer this active latency length in 
each brain region as “activity.” 

We performed a repeated measure analysis of 
variance (ANOVA) on the correct reaction rate and 
the reaction time. Two-way ANOVA (experiment x 
reacting finger) examined the difference between the 
experiments or tasks and between the reacting 
fingers, which means the left directed arrow vs. right 
directed arrow in Experiment-1, and match vs. 
mismatch in Experiment-2. 

As for the ECD activity data, we first performed 
repeated measure ANOVA on the data from 
Experiment-2 (two-way: match-mismatch x 
hemisphere). As a result of this ANOVA, there was 
not a significant difference between match and 
mismatch conditions, and thus we pooled the data 
from match and mismatch conditions. 



Reaction time 

Exp-1 [400 ms] Exp-2 [725 ms] 



Experiment-1: one object 


Experiment-2: three objects 


Figure 3: Response waveforms from 122 channels [Grand mean across 12 subjects] 

Response waveforms in Experiment-1 (thin solid curves) and in Experiment-2 (thick solid curves). Responses 
over the left occipitotemporal region, the right occipitoparietal region, and the parietotemporal region are 
enlarged in the right panel. The vertical lines in the right panel show the mean reaction times in Experiment-1 
(400 ms) and in Experiment-2 (725 ms). The stimulus was exposed from 0 to 100 ms. 










































































































Second, we did repeated measure ANOVA on the 
ECD activity data from Experiment-1 and 
Experiment-2 (two-way: experiment x hemisphere). 
Third, we compared the activity of each brain region 
between Experiment-1 and Experiment-2 by paired 
t-test. Finally we compared the number of subjects 
who showed activity in each of 28 brain regions 
between conditions by Chi Square Test or Fisher’s 
Exact Test. 

3 Results 

Table 1 shows the correct reaction rate and the 
reaction time averaged across 12 subjects for 
Experiment-1 and Experiment-2. 


Table 1 Correct reaction rate and reaction time 



Ex 

p-1 

Ex 

P-2 

L 

R 

match 

mismatch 

LVF 

RVF 

LVF 

RVF 

Correct Rate [%] 

98 

97 

94 

93 

94 

95 

Reaction Time [ms] 

400 

400 

723 

727 

757 

766 


The repeated measure ANOVA indicated significant 
main effect “experiment” both in correct rate (F(l, 
11) =16.9, p=0.0017) and in reaction time (F(l, 
11)=266, p=0.5 x 10" 8 ). In reaction time, main effect 
“reacting finger” was also significant (F(l,ll)=11.2, 
p=0.0066). In reaction time, the interaction 
“experiment x reacting finger” was also significant 
(F(l, 11)=15.3, p=0.0024). 

The correct rate was significantly larger in 
Experiment-1 than in Experiment-2. The reaction 
time was significantly shorter in Experiment-1 than 
in Experiment-2. The reaction time was significantly 
shorter for “match” than “mismatch” condition in 
Experiment-2 although no difference was found in 
“reacting finger” in Experiment-1. 

Figure 3 describes the grand mean waveforms of 12 
subjects. Except for the reaction-related responses 
seen over the left and right motor areas, larger and 
longer activity for Experiment-2 than Experiment-1 
is observed in the left occipitotemporal region, the 
right parietotemporal region, and the right 
occipitoparietal region, as shown by 3 enlarged 
waveforms. 

Figure 4 illustrates typical examples of active 
locations in Experiment-2. Main active areas were 
the areas around the left calcarine fissure, the left 
occipitotemporal region, the right occipitoparietal 
region, the right angular region, and the right 
supramarginal region. 



LtCaF: left calcarine fissure, LtOcTe: left occipitotemporal area, 
RtOcPa: right occipitoparietal area, RtAngG: right angular gyrus, 
RtSmG: right supramarginal gyrus 


Figure 4: Typical active regions in Experiment-2. 
The left panel shows the coronal section, the middle 
panel the sagittal section, and the right panel the 
axial section of each subject’s magnetic resonance 
image (MRI). Each row corresponds to a single 
active region of one subject, which is shown by the 
cross point of white vertical and horizontal hair 
lines. “L” means the left side of the subject’s head, 
and “R” the right side. The first row shows the 
activity in the left occipitotemporal region, the 
second row the right occipitoparietal region, the 
third row the right angular region, and the fourth 
row the right supramarginal region. 

These active regions showed stronger or longer 
activity in Experiment-2 than in Experiment-1. 
Figure 5 describes the activity of the typical active 
regions. The results of ANOVA for the data from 
Experiment-2 showed no significant difference 
between match and mismatch conditions. However, 
we found a significantly larger activity in the right 
than the left occipitoparietal region (paired t-test: 
match: t(ll)=2.1, p=0.059; mismatch: t(ll)=2.76, 
p=0.018). We also found significantly larger number 
of subjects who showed activity in the left than the 
right occipitotemporal region (match: p<0.03 [Chi 
Square Test]; mismatch: p<0.014 [Fisher’s Exact 
Test]). 


















Discussion 


Left Hemisphere [LH] vs. Right Hemisphere [RH] 



LH RH LH RH LH RH LH RH 

match nonmatch match nonmatch 
Occipitotemporal region Occipitoparietal region 


Experiment-1 vs. Experiment-2 



El E2 El E2 El E2 El E2 El E2 


LtCaF LtOcTe RtOcPa RtAngG RtSmG 
El: Experiment-1, one object 
E2: Experiment-2, three objects 

Figure 5: Top: Left panel shows the number of 
subjects who showed activity in the left (LH) and 
right (RH) occipitotemporal regions in Experiment- 
2. Right panel shows the activity in the left and right 
occipitoparietal regions in Experiment-2. Bottom: 
Activity in the area around the left calcarine fissure 
(LtCaF), the left occipitotemporal region (LtOcTe), 
the right occipitoparietal region (RtOcPa), the right 
angular region (RtAngG), and the right supra¬ 
marginal region (RtSmG) is compared between 
Experiment-1 (El) and Experiment-2 (E2). 

Because of no significant difference between match 
and mismatch conditions, we pooled the data from 
match and mismatch conditions into one set of data. 
The two-way repeated measure ANOVA revealed 
the significant main effect “experiment” (F(l, 
11)=25.81, p=0.00035), that is, the activity is 
significantly larger in Experiment-2 than in 
Experiment-1. Table 2 summarizes the brain regions 
that showed significantly larger activity in 
Experiment-2 than in Experiment-1 together with 
the probability obtained by the paired t-test. 


Table 2: Brain regions that showed significantly 
larger activity in Experiment-2 than in Experiment- 
1. “probability” was obtained by the paired t-test. 


Brain regions 

probability 

Region around the left calcarine fissure 

0.043 

Left occipitotemporal region 

0.024 

Right occipitoparietal region 

0.033 

Right angular region 

0.033 

Right supramarginal region 

0.030 


4 

In the occipitoparietal region, the angular region, 
and the supramarginal region, the activity was 
significantly larger in Experiment-2 than in 
Experiment-1. In the left calcarine fissure and the 
left occipitotemporal region, the activity was also 
significantly larger in Experiment-2 than in 
Experiment-1. 

In Experiment-2, the subject had to see and 
recognize 3 visual objects whereas in Experiment-1, 
the subject had to see and recognize only one visual 
object. Therefore, the simultanagnosics would be 
able to perform the task in Experiment-1 but not the 
task in Experiment-2. This implies that the task in 
Experiment-2 activates the brain regions of the 
normal subjects, which are related to the 
simultaneous visual object processing. 

From our results, we suggest that the right dorsal 
route from the occipitoparietal region to the right 
supramarginal region via the right angular region as 
well as the left ventral route from the left primary 
visual area to the left occipitotemporal region are 
involved in this simultaneous visual object 
recognition. 

According to Farah [2], the disorder occurs after 
bilateral occipitoparietal damage in the dorsal 
simultanagnosia, and after left occipitotemporal 
damage in the ventral simultanagnosia. Our active 
regions are in line with these damaged areas, 
implying that these areas are performing some roles 
related to simultaneous visual object recognition. 

We do not yet clarify the role of these two routes. 
However, as Farah pointed out, it may be largely 
possible that the right dorsal route plays a role for 
the visual attention. 

In our data, the left dorsal route was not so strongly 
activated whereas Farah claimed that the bilateral 
occipitoparietal damage causes the dorsal 
simultanagnosia. This discrepancy should be 
clarified in the future research. 
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